Visual Odometry and Place Recognition Fusion for Vehicle Position Tracking in Urban Environments
Identifieur interne : 000449 ( Main/Exploration ); précédent : 000448; suivant : 000450Visual Odometry and Place Recognition Fusion for Vehicle Position Tracking in Urban Environments
Auteurs : Safa Ouerghi ; Rémi Boutteau ; Xavier Savatier ; Fethi TliliSource :
- Sensors (Basel, Switzerland) [ 1424-8220 ] ; 2018.
Abstract
In this paper, we address the problem of vehicle localization in urban environments. We rely on visual odometry, calculating the incremental motion, to track the position of the vehicle and on place recognition to correct the accumulated drift of visual odometry, whenever a location is recognized. The algorithm used as a place recognition module is SeqSLAM, addressing challenging environments and achieving quite remarkable results. Specifically, we perform the long-term navigation of a vehicle based on the fusion of visual odometry and SeqSLAM. The template library for this latter is created online using navigation information from the visual odometry module. That is, when a location is recognized, the corresponding information is used as an observation of the filter. The fusion is done using the EKF and the UKF, the well-known nonlinear state estimation methods, to assess the superior alternative. The algorithm is evaluated using the KITTI dataset and the results show the reduction of the navigation errors by loop-closure detection. The overall position error of visual odometery with SeqSLAM is 0.22% of the trajectory, which is much smaller than the navigation errors of visual odometery alone 0.45%. In addition, despite the superiority of the UKF in a variety of estimation problems, our results indicate that the UKF performs as efficiently as the EKF at the expense of an additional computational overhead. This leads to the conclusion that the EKF is a better choice for fusing visual odometry and SeqSlam in a long-term navigation context.
Url:
DOI: 10.3390/s18040939
PubMed: 29565310
PubMed Central: 5948842
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 000278
- to stream Pmc, to step Curation: 000277
- to stream Pmc, to step Checkpoint: 000138
- to stream PubMed, to step Corpus: 000362
- to stream PubMed, to step Curation: 000361
- to stream PubMed, to step Checkpoint: 000308
- to stream Main, to step Merge: 000449
- to stream Main, to step Curation: 000449
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Visual Odometry and Place Recognition Fusion for Vehicle Position Tracking in Urban Environments</title><author><name sortKey="Ouerghi, Safa" sort="Ouerghi, Safa" uniqKey="Ouerghi S" first="Safa" last="Ouerghi">Safa Ouerghi</name><affiliation><nlm:aff id="af1-sensors-18-00939">Carthage University, SUP’COM, GRESCOM, El Ghazela 2083, Tunisia;<email>fethi.tlili@supcom.tn</email></nlm:aff></affiliation></author><author><name sortKey="Boutteau, Remi" sort="Boutteau, Remi" uniqKey="Boutteau R" first="Rémi" last="Boutteau">Rémi Boutteau</name><affiliation><nlm:aff id="af2-sensors-18-00939">Normandie University, UNIROUEN, ESIGELEC, IRSEEM, 76000 Rouen, France;<email>remi.boutteau@esigelec.fr</email> (R.B.);<email>xavier.savatier@esigelec.fr</email> (X.S.)</nlm:aff></affiliation></author><author><name sortKey="Savatier, Xavier" sort="Savatier, Xavier" uniqKey="Savatier X" first="Xavier" last="Savatier">Xavier Savatier</name><affiliation><nlm:aff id="af2-sensors-18-00939">Normandie University, UNIROUEN, ESIGELEC, IRSEEM, 76000 Rouen, France;<email>remi.boutteau@esigelec.fr</email> (R.B.);<email>xavier.savatier@esigelec.fr</email> (X.S.)</nlm:aff></affiliation></author><author><name sortKey="Tlili, Fethi" sort="Tlili, Fethi" uniqKey="Tlili F" first="Fethi" last="Tlili">Fethi Tlili</name><affiliation><nlm:aff id="af1-sensors-18-00939">Carthage University, SUP’COM, GRESCOM, El Ghazela 2083, Tunisia;<email>fethi.tlili@supcom.tn</email></nlm:aff></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">29565310</idno><idno type="pmc">5948842</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5948842</idno><idno type="RBID">PMC:5948842</idno><idno type="doi">10.3390/s18040939</idno><date when="2018">2018</date><idno type="wicri:Area/Pmc/Corpus">000278</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">000278</idno><idno type="wicri:Area/Pmc/Curation">000277</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Curation">000277</idno><idno type="wicri:Area/Pmc/Checkpoint">000138</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Checkpoint">000138</idno><idno type="wicri:source">PubMed</idno><idno type="RBID">pubmed:29565310</idno><idno type="wicri:Area/PubMed/Corpus">000362</idno><idno type="wicri:explorRef" wicri:stream="PubMed" wicri:step="Corpus" wicri:corpus="PubMed">000362</idno><idno type="wicri:Area/PubMed/Curation">000361</idno><idno type="wicri:explorRef" wicri:stream="PubMed" wicri:step="Curation">000361</idno><idno type="wicri:Area/PubMed/Checkpoint">000308</idno><idno type="wicri:explorRef" wicri:stream="Checkpoint" wicri:step="PubMed">000308</idno><idno type="wicri:Area/Main/Merge">000449</idno><idno type="wicri:Area/Main/Curation">000449</idno><idno type="wicri:Area/Main/Exploration">000449</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Visual Odometry and Place Recognition Fusion for Vehicle Position Tracking in Urban Environments</title><author><name sortKey="Ouerghi, Safa" sort="Ouerghi, Safa" uniqKey="Ouerghi S" first="Safa" last="Ouerghi">Safa Ouerghi</name><affiliation><nlm:aff id="af1-sensors-18-00939">Carthage University, SUP’COM, GRESCOM, El Ghazela 2083, Tunisia;<email>fethi.tlili@supcom.tn</email></nlm:aff></affiliation></author><author><name sortKey="Boutteau, Remi" sort="Boutteau, Remi" uniqKey="Boutteau R" first="Rémi" last="Boutteau">Rémi Boutteau</name><affiliation><nlm:aff id="af2-sensors-18-00939">Normandie University, UNIROUEN, ESIGELEC, IRSEEM, 76000 Rouen, France;<email>remi.boutteau@esigelec.fr</email> (R.B.);<email>xavier.savatier@esigelec.fr</email> (X.S.)</nlm:aff></affiliation></author><author><name sortKey="Savatier, Xavier" sort="Savatier, Xavier" uniqKey="Savatier X" first="Xavier" last="Savatier">Xavier Savatier</name><affiliation><nlm:aff id="af2-sensors-18-00939">Normandie University, UNIROUEN, ESIGELEC, IRSEEM, 76000 Rouen, France;<email>remi.boutteau@esigelec.fr</email> (R.B.);<email>xavier.savatier@esigelec.fr</email> (X.S.)</nlm:aff></affiliation></author><author><name sortKey="Tlili, Fethi" sort="Tlili, Fethi" uniqKey="Tlili F" first="Fethi" last="Tlili">Fethi Tlili</name><affiliation><nlm:aff id="af1-sensors-18-00939">Carthage University, SUP’COM, GRESCOM, El Ghazela 2083, Tunisia;<email>fethi.tlili@supcom.tn</email></nlm:aff></affiliation></author></analytic><series><title level="j">Sensors (Basel, Switzerland)</title><idno type="eISSN">1424-8220</idno><imprint><date when="2018">2018</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>In this paper, we address the problem of vehicle localization in urban environments. We rely on visual odometry, calculating the incremental motion, to track the position of the vehicle and on place recognition to correct the accumulated drift of visual odometry, whenever a location is recognized. The algorithm used as a place recognition module is SeqSLAM, addressing challenging environments and achieving quite remarkable results. Specifically, we perform the long-term navigation of a vehicle based on the fusion of visual odometry and SeqSLAM. The template library for this latter is created online using navigation information from the visual odometry module. That is, when a location is recognized, the corresponding information is used as an observation of the filter. The fusion is done using the EKF and the UKF, the well-known nonlinear state estimation methods, to assess the superior alternative. The algorithm is evaluated using the KITTI dataset and the results show the reduction of the navigation errors by loop-closure detection. The overall position error of visual odometery with SeqSLAM is 0.22% of the trajectory, which is much smaller than the navigation errors of visual odometery alone 0.45%. In addition, despite the superiority of the UKF in a variety of estimation problems, our results indicate that the UKF performs as efficiently as the EKF at the expense of an additional computational overhead. This leads to the conclusion that the EKF is a better choice for fusing visual odometry and SeqSlam in a long-term navigation context.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Milford, M J" uniqKey="Milford M">M.J. Milford</name></author><author><name sortKey="Wyeth, G F" uniqKey="Wyeth G">G.F. Wyeth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Milford, M" uniqKey="Milford M">M. Milford</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bonardi, F" uniqKey="Bonardi F">F. Bonardi</name></author><author><name sortKey="Ainouz, S" uniqKey="Ainouz S">S. Ainouz</name></author><author><name sortKey="Boutteau, R" uniqKey="Boutteau R">R. Boutteau</name></author><author><name sortKey="Dupuis, Y" uniqKey="Dupuis Y">Y. Dupuis</name></author><author><name sortKey="Savatier, X" uniqKey="Savatier X">X. Savatier</name></author><author><name sortKey="Vasseur, P" uniqKey="Vasseur P">P. Vasseur</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Stone, T" uniqKey="Stone T">T. Stone</name></author><author><name sortKey="Mangan, M" uniqKey="Mangan M">M. Mangan</name></author><author><name sortKey="Ardin, P" uniqKey="Ardin P">P. Ardin</name></author><author><name sortKey="Webb, B" uniqKey="Webb B">B. Webb</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sunderhauf, N" uniqKey="Sunderhauf N">N. Sünderhauf</name></author><author><name sortKey="Shirazi, S" uniqKey="Shirazi S">S. Shirazi</name></author><author><name sortKey="Dayoub, F" uniqKey="Dayoub F">F. Dayoub</name></author><author><name sortKey="Upcroft, B" uniqKey="Upcroft B">B. Upcroft</name></author><author><name sortKey="Milford, M" uniqKey="Milford M">M. Milford</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sunderhauf, N" uniqKey="Sunderhauf N">N. Sünderhauf</name></author><author><name sortKey="Neubert, P" uniqKey="Neubert P">P. Neubert</name></author><author><name sortKey="Protzel, P" uniqKey="Protzel P">P. Protzel</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kalman, R E" uniqKey="Kalman R">R.E. Kalman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cummins, M" uniqKey="Cummins M">M. Cummins</name></author><author><name sortKey="Newman, P" uniqKey="Newman P">P. Newman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Cummins, M" uniqKey="Cummins M">M. Cummins</name></author><author><name sortKey="Newman, P" uniqKey="Newman P">P. Newman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Badino, H" uniqKey="Badino H">H. Badino</name></author><author><name sortKey="Huber, D" uniqKey="Huber D">D. Huber</name></author><author><name sortKey="Kanade, T" uniqKey="Kanade T">T. Kanade</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Baatz, G" uniqKey="Baatz G">G. Baatz</name></author><author><name sortKey="Koser, K" uniqKey="Koser K">K. Köser</name></author><author><name sortKey="Chen, D" uniqKey="Chen D">D. Chen</name></author><author><name sortKey="Grzeszczuk, R" uniqKey="Grzeszczuk R">R. Grzeszczuk</name></author><author><name sortKey="Pollefeys, M" uniqKey="Pollefeys M">M. Pollefeys</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Oh, S" uniqKey="Oh S">S. Oh</name></author><author><name sortKey="Tariq, S" uniqKey="Tariq S">S. Tariq</name></author><author><name sortKey="Walker, B" uniqKey="Walker B">B. Walker</name></author><author><name sortKey="Dellaert, F" uniqKey="Dellaert F">F. Dellaert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Milford, M" uniqKey="Milford M">M. Milford</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Clipp, B" uniqKey="Clipp B">B. Clipp</name></author><author><name sortKey="Lim, J" uniqKey="Lim J">J. Lim</name></author><author><name sortKey="Frahm, J M" uniqKey="Frahm J">J.-M. Frahm</name></author><author><name sortKey="Pollefeys, M" uniqKey="Pollefeys M">M. Pollefeys</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Geiger, A" uniqKey="Geiger A">A. Geiger</name></author><author><name sortKey="Lenz, P" uniqKey="Lenz P">P. Lenz</name></author><author><name sortKey="Urtasun, R" uniqKey="Urtasun R">R. Urtasun</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Geiger, A" uniqKey="Geiger A">A. Geiger</name></author><author><name sortKey="Ziegler, J" uniqKey="Ziegler J">J. Ziegler</name></author><author><name sortKey="Stiller, C" uniqKey="Stiller C">C. Stiller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kaess, M" uniqKey="Kaess M">M. Kaess</name></author><author><name sortKey="Ni, K" uniqKey="Ni K">K. Ni</name></author><author><name sortKey="Dellaert, F" uniqKey="Dellaert F">F. Dellaert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Newcombe, R A" uniqKey="Newcombe R">R.A. Newcombe</name></author><author><name sortKey="Lovegrove, S J" uniqKey="Lovegrove S">S.J. Lovegrove</name></author><author><name sortKey="Davison, A J" uniqKey="Davison A">A.J. Davison</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ranganathan, A" uniqKey="Ranganathan A">A. Ranganathan</name></author><author><name sortKey="Dellaert, F" uniqKey="Dellaert F">F. Dellaert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Paul, R" uniqKey="Paul R">R. Paul</name></author><author><name sortKey="Newman, P" uniqKey="Newman P">P. Newman</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kaess, M" uniqKey="Kaess M">M. Kaess</name></author><author><name sortKey="Johannsson, H" uniqKey="Johannsson H">H. Johannsson</name></author><author><name sortKey="Roberts, R" uniqKey="Roberts R">R. Roberts</name></author><author><name sortKey="Ila, V" uniqKey="Ila V">V. Ila</name></author><author><name sortKey="Leonard, J J" uniqKey="Leonard J">J.J. Leonard</name></author><author><name sortKey="Dellaert, F" uniqKey="Dellaert F">F. Dellaert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Mei, C" uniqKey="Mei C">C. Mei</name></author><author><name sortKey="Sibley, G" uniqKey="Sibley G">G. Sibley</name></author><author><name sortKey="Cummins, M" uniqKey="Cummins M">M. Cummins</name></author><author><name sortKey="Newman, P" uniqKey="Newman P">P. Newman</name></author><author><name sortKey="Reid, I" uniqKey="Reid I">I. Reid</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brubaker, M A" uniqKey="Brubaker M">M.A. Brubaker</name></author><author><name sortKey="Geiger, A" uniqKey="Geiger A">A. Geiger</name></author><author><name sortKey="Urtasun, R" uniqKey="Urtasun R">R. Urtasun</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Floros, B L G" uniqKey="Floros B">B.L.G. Floros</name></author><author><name sortKey="Van Der Zander, B" uniqKey="Van Der Zander B">B. van der Zander</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Hentschel, M" uniqKey="Hentschel M">M. Hentschel</name></author><author><name sortKey="Wagner, B" uniqKey="Wagner B">B. Wagner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Chu, H" uniqKey="Chu H">H. Chu</name></author><author><name sortKey="Mei, H" uniqKey="Mei H">H. Mei</name></author><author><name sortKey="Bansal, M" uniqKey="Bansal M">M. Bansal</name></author><author><name sortKey="Walter, M R" uniqKey="Walter M">M.R. Walter</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Majdik, A L" uniqKey="Majdik A">A.L. Majdik</name></author><author><name sortKey="Verda, D" uniqKey="Verda D">D. Verda</name></author><author><name sortKey="Albers Schoenberg, Y" uniqKey="Albers Schoenberg Y">Y. Albers-Schoenberg</name></author><author><name sortKey="Scaramuzza, D" uniqKey="Scaramuzza D">D. Scaramuzza</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pepperell, E" uniqKey="Pepperell E">E. Pepperell</name></author><author><name sortKey="Corke, P" uniqKey="Corke P">P. Corke</name></author><author><name sortKey="Milford, M" uniqKey="Milford M">M. Milford</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kummerle, R" uniqKey="Kummerle R">R. Kümmerle</name></author><author><name sortKey="Grisetti, G" uniqKey="Grisetti G">G. Grisetti</name></author><author><name sortKey="Strasdat, H" uniqKey="Strasdat H">H. Strasdat</name></author><author><name sortKey="Konolige, K" uniqKey="Konolige K">K. Konolige</name></author><author><name sortKey="Burgard, W" uniqKey="Burgard W">W. Burgard</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Thrun, S" uniqKey="Thrun S">S. Thrun</name></author><author><name sortKey="Burgard, W" uniqKey="Burgard W">W. Burgard</name></author><author><name sortKey="Fox, D" uniqKey="Fox D">D. Fox</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Scaramuzza, D" uniqKey="Scaramuzza D">D. Scaramuzza</name></author><author><name sortKey="Fraundorfer, F" uniqKey="Fraundorfer F">F. Fraundorfer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kneip, L" uniqKey="Kneip L">L. Kneip</name></author><author><name sortKey="Furgale, P" uniqKey="Furgale P">P. Furgale</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fischler, M A" uniqKey="Fischler M">M.A. Fischler</name></author><author><name sortKey="Bolles, R C" uniqKey="Bolles R">R.C. Bolles</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dingfu, Z" uniqKey="Dingfu Z">Z. Dingfu</name></author><author><name sortKey="Dai, Y" uniqKey="Dai Y">Y. Dai</name></author><author><name sortKey="Hongdong, L" uniqKey="Hongdong L">L. Hongdong</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Thrun, S" uniqKey="Thrun S">S. Thrun</name></author><author><name sortKey="Fox, D" uniqKey="Fox D">D. Fox</name></author><author><name sortKey="Burgard, W" uniqKey="Burgard W">W. Burgard</name></author><author><name sortKey="Dellaert, F" uniqKey="Dellaert F">F. Dellaert</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ouerghi, S" uniqKey="Ouerghi S">S. Ouerghi</name></author><author><name sortKey="Boutteau, R" uniqKey="Boutteau R">R. Boutteau</name></author><author><name sortKey="Tlili, F" uniqKey="Tlili F">F. Tlili</name></author><author><name sortKey="Savatier, X" uniqKey="Savatier X">X. Savatier</name></author></analytic></biblStruct></listBibl></div1></back></TEI><affiliations><list></list><tree><noCountry><name sortKey="Boutteau, Remi" sort="Boutteau, Remi" uniqKey="Boutteau R" first="Rémi" last="Boutteau">Rémi Boutteau</name><name sortKey="Ouerghi, Safa" sort="Ouerghi, Safa" uniqKey="Ouerghi S" first="Safa" last="Ouerghi">Safa Ouerghi</name><name sortKey="Savatier, Xavier" sort="Savatier, Xavier" uniqKey="Savatier X" first="Xavier" last="Savatier">Xavier Savatier</name><name sortKey="Tlili, Fethi" sort="Tlili, Fethi" uniqKey="Tlili F" first="Fethi" last="Tlili">Fethi Tlili</name></noCountry></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Sante/explor/MaghrebDataLibMedV2/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000449 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000449 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Sante
|area= MaghrebDataLibMedV2
|flux= Main
|étape= Exploration
|type= RBID
|clé= PMC:5948842
|texte= Visual Odometry and Place Recognition Fusion for Vehicle Position Tracking in Urban Environments
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Exploration/RBID.i -Sk "pubmed:29565310" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd \
| NlmPubMed2Wicri -a MaghrebDataLibMedV2
| This area was generated with Dilib version V0.6.38. |  |